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I.  INTRODUCTION 


This  report  was  prepared  for  the  Advanced  Logistics  Research 
Division,  Bureau  of  Supplies  and  Accounts ,  U.  S.  Navy,  in  partial  fulfill¬ 
ment  of  Navy  Contract  Nonr  2904(00). 

A  major  goal  of  die  Navy  is  to  develop  scientific  inventory  decision 
rules  chat  will  reduce  supply  system  costs  while  maintaining  system  effective¬ 
ness.  As  an  importanc  step  in  developing  these  rules,  the  Navy  is  devoting 
much  effort  to  the  construction  of  mathematical  models  that  describe  the  cost 
and  service  effects  of  inventory  policies.  The  utility  of  the  rules  in  minimizing 
system  cost  depends  upon  the  ability  of  the  mathematical  models  to  approximate 
real-world  behavior. 

The  essential  components  of  a  mathematical  model  of  an  inventory 

1/ 

system  are;-' 

1.  The  direct  costs  of  operating  the  system,  e.g.  , 
holding  costs , transportation  costs,  procurement 
order  costs. 

2.  The  imputed  costs  of  departing  from  system 
effectiveness  criteria,  e.g.,  stockout  costs. 

3.  The  administrative  costs  of  managing  the 
system,  e.g,,  data  collection,  transmittal 
and  processing  costs. 

4.  The  constraints  imposed  on  the  system,  e.g., 
warehouse  capacities,  budget  limitations. 

5.  The  demand  process  that  the  system  must 
satisfy,  e.g.,  periodic  replenishment, 
random  failures. 


1/  See  for  example,  Transportation-Inventory  Trade-offs,  Phase  B,  Decision 
Models  for  Supply  System  Operations,  prepared  for  Bureau  of  Supplies  and 
Accounts  under  Navy  Contract  Nonr  2904(00),  by  United  Research  Inc.,  1960. 
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In  this  report  we  are  concerned  with  mathematical  characterizations 
of  only  the  demand  processes.  In  the  majority  of  supply  situations,  the 
quantity  that  will  be  demanded  in  a  given  time  period  is  uncertain.  Consequently, 
the  behavior  of  demand  with  time  must  be  considered  to  be  a  random  process, 
describable  only  in  terms  of  probability  distributions.  Our  primary  interest  is 
in  the  exploration  of  probability  distributions  for  describing  demand  that  are 
useful  in  constructing  inventory  models. 

Ideally,  all  Navy  Supply  System  items  could  be  described  by  a  single 
distribution  having  but  one  parameter,  say  average  demand  per  time  period. 

The  nature  of  replacement  demand,  however,  varies  widely  among  items  in  the 
syscem.  Some  items  are  consumed  in  a  regular  manner  that  can  be  predicted 
with  precision,  such  as  food  items,  and  items  that  are  not  actually  consumed, 
bu*.  may  be  replaced  periodically,  or  arbitrarily,  such  as  submarine  batteries 
and  paint.  Other  items  are  consumed  in  a  purely  random  fashion.  This  is  the 
case,  for  example,  with  certain  ship  parts,  or  items  that  have  working  lives 
much  longer  than  useful  lives  and  need  replacement  due  to  "accidental" 
failures.  Hatch  covers,  ship's  propellers  and  shafts,  and  ladders  are  items 
in  this  category. 

It  is  thus  possible  to  distinguish  several  classes  of  items  that  differ 
from  each  other  not  only  in  their  average  demand  per  time  period,  but  also  in 
their  variability  of  demand.  The  most  commonly  used  mathematical  model  which 
assumes  that  the  quantity  demanded  will  always  be  one  unit  and  that  a  demand 
is  as  likely  in  any  one  short  time  period  as  in  any  other,  is  not  capable  of 
describing  the  behavior  of  all  these  classes. 

Consequently,  investigators  have  sought  more  general  mathematical 
models  capable  of  providing  a  better  description  of  the  observed  demand 
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processes.  Two  of  the  models  that  have  frequently  been  suggested  are  the 
negative  binomial  and  the  stuttering  Poisson. 

To  understand  why  such  distributions  have  been  favored  over  the 
infinite  number  of  possible  demand  models,  it  is  necessary  to  consider  the 
factors  that  must  influence  the  investigator  in  selecting  a  distribution.  It 
is  of  primary  importance  to  recognize  that  any  probability  distribution  selected 
to  describe  a  demand  process  will  be  an  approximation.  It  is  an  approximation 
in  the  sense  that  there  is  no  experimental  method  for  determining  with  absolute 
certainty  the  fact  that  the  model  corresponds  to  reality.  Nevertheless,  an 
approximation  is  an  adequate  representation  of  the  process  if  there  is  a  high 
probability  that  the  past  history  of  the  demand  process  could  have  been 
generated  by  the  model.  If  the  past  history  of  demand  is  an  improbable 
realization  of  the  process  described  by  the  model,  then  the  course  of  prudence 
is  to  reject  the  model.  On  the  other  hand,  there  may  be  many  probabilistic 
models  that  could  have  generated  the  observed  demand  with  high  probability; 
in  this  case,  statistical  considerations  alone  cannot  serve  as  a  basis  for 
deciding  which  of  these  models  is  an  appropriate  representation  of  the  demand 
process . 

The  use  of  empirical  distributions  of  demand  in  inventory  system 
models  is  seen  to  be  especially  unsound  in  view  of  the  preceding  argument. 

The  past  history  of  demand  is  but  a  single  realization  of  the  demand  process, 
and  the  accumulation  of  future  demand  data  may  show  that  it  was  an  extremely 
improbable  realization. 

A  second  important  factor  in  selecting  demand  distributions  is  that, 
for  practical  reasons,  only  those  approximating  distributions  that  are  relatively 
simple  in  form  can  be  considered  to  be  satisfactory.  There  are  several  reasons 
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why  we  seek  simplicity,  in  ihe  sense  ot  mathematical  tractibilny  and  descrip¬ 
tion  of  item  demand  by  a  limited  number  of  parameters.  Mathematically 
tractiblc  demand  distributions  are  pre>  equisites  to  the  mathematical  analysis  oi 
inventoi  y  systems.  In  fact,  only  the  most  elementary  properties  of  an  inventor*/ 
system  can  be  determined  mathematically  if  the  demand  distribution  of  the 
system  cannot  be  considered  to  belong  to  a  surprisingly  small  class  of  probe bilit 
distributions.  Furthermore ,  the  development  of  control  rules  is  made  almost 
.mpossibiy  difficult  unless  this  condition  is  met. 

Limitation  of  the  number  of  parameters  of  the  distribution  is  required 
because  the  limited  amount  of  data  available  in  most  inventory  situations  is 
sufficient  lo  yield  statistically  significant  estimates  of  only  a  few  parameters. 

To  the  extent  that  the  models  contain  more  parameters  than  can  be  estimated 
with  assurance,  the  investigator  would  be  better  advised  to  use  a  simpler 
demand  model  until  more  information  on  tae  demand  process  is  accumulated. 
Since  in  most  demand  situations,  only  the  mean  and  variance  can  be  meaning¬ 
fully  measured  or  predicted,  only  inose  models  whose  parameters  are  deter¬ 
minable  from  these  quantities  shouiu  be  employed. 

Anothet  important  factor  in  selec.ing  a  demand  distribution  is 
associated  with  simplicity  nut  not  directly  related  to  it.  This  factor  is  he 
physical  interpretabilny  of  the  probability  distribuoons  used  to  describe 
demand.  A  majoi  distinction  between  the  statistician  or  mathematician  and 
the  operations  analyt.  lies  in  their  regard  for  the  physical  interpretabilny 
of  the  results.  The  mathematician  is  primarily  concerned  with  the  "fit" 
of  his  theoretical  distribution  to  the  emprical  distribution.  If  the  fit  n  good 
in  a  statistical  sens*.  ,  tnen  the  mathematician  can  usually  decide  that  up  h^s 
obtained  a  satisfactory  description  of  tne  process.  The  operations  analyst, 
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on  the  other  hand,  requires  not  only  mathematical  significance,  but  also 
physical  reasonableness  of  the  results.  The  operations  analyst  first  observes 
the  physical  process  of  demand  and  then  hypothesizes  a  microscopic  model 
of  demand.  He  determines  the  over-all  demand  distribution  that  would  be 
generated  by  the  microscopic  model,  and,  at  this  point,  establishes  the 
validity  of  his  characterization  of  the  process  by  comparing  the  statistical 
properties  of  his  model  with  those  of  the  real  world. 

The  distinction  between  the  two  approaches  is  not  trivial.  The 
requirement  of  physical  reasonableness  helps  to  assure  the  operations  analyst 
that  he  has  not  ignored  some  important  physical  aspects  of  the  problem  in 
formulating  the  mathematical  model.  Just  as  one  would  be  wary  of  driving 
over  bridges,  or  of  flying  in  airplanes  designed  entirely  by  mathematicians, 
so  should  he  be  cautious  in  accepting  the  results  of  an  inventory  model  based 
on  mathematical  considerations  alone. 
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II.  SUMMARY 


The  purpose  of  this  report  is  to  examine  the  probability  distributions 
uhat  are  pertinent  to  the  description  of  Navy  replacement  demand  processes. 
Demand  patterns  observed  in  the  Navy  Supply  System  indicate  that  the  actual 
demand  process  is  complicated.  Simple  Poisson  models  for  demand  appear  to 
be  useful  only  in  special  situations,  such  as  for  certain  classes  of  items  that 
have  very  low  demand  rates.  The  remaining  situations  indicate  that  there  is 
more  "clumping"  of  demand  or  regularity  of  time  between  demands  than  is 
predicted  by  the  Poisson  model. 

Consequently,  various  investigators  have  proposed  other  models 
that  allow  for  a  range  of  variance-io-mean  ratios  and  other  statistical  param¬ 
eters  of  demand  to  capture  the  basic  nature  of  these  more  complex  patterns.  In 
particular  such  distributions  as  the  negative  binomial,  stuttering  Poisson, 
geometric  Poisson  and  the  Erlang  appear  frequently  in  the  literature  of  logistics 
systems,  and  are  discussed  in  this  report.  Scrutiny  of  these  models  has 
revealed  that  the  class  of  models  that  has  been  considered  for  describing  the 
demand  process  is  not  so  large  as  it  might  appear  because  some  of  the  models 
are  special  cases  of  others.  In  particular  the  following  properties  of  commonly 
used  demand  distributions  do  not  seem  to  be  generally  appreciated  by  inventory 
systems  analysts; 

1.  The  assumption  that  demand  in  any  time  period  is 
statistically  independent  of  demand  in  any  other 
non-overlapping  time  period  implies  that  the 
demand  must  be  described  by  a  member  of  the  class 
of  distributions  known  as  compound  Poisson.-^/ 


1/  Although  some  investigators  use  the  term  compound  Poisson  to  refer  to  the 
sputtering  Poisson  distribution,  this  usage  is  misleading  since  many  other 
distributions  are  also  compound  Poisson  distributions. 
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2. 


Although  the  stuttering  Poisson  and  the  geometric 
Poisson  distributions  are  apparently  considered  to 
be  essentially  different  by  many  investigators, 
there  is  no  difference  when  the  initial  conditions 
of  the  demand  processes  are  appropriately  selected. 

3.  The  negative  binomial  distribution,  which  is 

frequently  advocated  as  a  demand  distribution,  is 
interpretable  as  a  compound  Poisson  distribution 
in  most  situations.  Furthermore,  there  are  several 
microscopic  demand  models  that  can  lead  to  over¬ 
all  demand  distributions  of  the  negative  binomial 
family.  In  accordance  with  the  earlier  discussion 
of  physical  reasonableness,  the  appropriateness 
of  the  negative  binomial  in  describing  a  demand 
process  can  be  evaluated  by  determining  whether 
one  of  these  microscopic  models  is  a  reasonable 
source  of  demand. 

In  the  remainder  of  this  report,  a  systematic  analysis  of  demand 
distributions  will  be  presented.  This  analysis  will  establish  not  only  the 
results  indicated,  but  will  also  consider  demand  distributions  from  a  more 
general  point  of  view. 
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III.  COMPOUND  DISTRIBUTIONS 


Introduction 

The  largest  class  of  probability  distributions  useful  for  the  descrip¬ 
tion  of  demand  appears  to  be  the  class  of  compound  distributions.  These 
distributions  are  capable  of  describing  fairly  general  demand  processes  often 
without  a  sacrifice  of  analytic  tractibility.  Simplicity  in  mathematical 
analysis  is  most  likely  to  exist  where  the  demand  process  is  of  the  generalized 
Poisson  family  that  is  usually  assumed  explicitly  or  implicitly  in  the  literature 
of  inventory  control.  This  chapter  develops  the  theory  of  compound  distribu¬ 
tions.  In  Chapter  IV  the  theory  of  recurrent  events  is  developed  as  a  foundation 
for  later  chapters.  Chapter  V  presents  the  theory  of  compound  Poisson  processes 
as  an  important  family  of  compound  distributions.  A  second  family  of  distri¬ 
butions  that  may  bo  useful  in  the  description  of  demand,  the  Erlang  process,  is 
sugj«  sted  in  Chapter  VI. 

Dcvt  lopmont  oi  the  Compound  Distribution  and  its  z-Transform 

The  process  by  which  compound  distributions  are  generated  is 
described  as  follows.  Consider  two  independent  random  variables  n  and  k 
with  density  functions  f(n)  and  g(k).  The  functions  f(n)  and  g(k)  will  be  called 
the  compounding  and  sampling  distributions  respectively.  The  function  g(k) 
can  have  non- aero  values  only  for  non-negative  integers,  k.  The  function  f(n) 
could  have  as  its  domain  any  real  number,  but  we  shall  restrict  its  domain  to 
the  integers  tor  our  present  discussion.-^  In  accordance  with  the  integral 
domains  of  the  compounding  and  sampling  distributions  it  is  possible  for  us  to 
think  of  these  distributions  as  probability  mass  functions  rather  than  probability 

J/  The  extension  of  the  aigument  to  the  case  where  n  can  be  a  continuous 
\nnnHt  .s  developed  in  Ihe  appendix  to  this  report. 
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..c it.  •_  u  •.••ions ,  however  we  snail  l .  ■  inior  .--*i m. 

i.et  in  du  the  sum  ot  k  n '.depend".'..  i<jn**..>in  c.  .ni-.i.s  nom  f(n) , 
vvhoie  k  is  o  o inborn  variable  from  ..(h).  'i  ;h  .viivo  >•+  t.riu  h(m) ,  .ne 
hens' v\  function  of  rn.  The  funcu  .*:i  n(ia)  is  called  h<e  i>iiw;uad  distribute  on 
..onoralou  by  iht*  functions  f(n)  end  c, (O .  I,..  i(«.|l-)  L*  -.he  probability  that 

.he  sun  j.  k  samples  from  f(n)  .ekes  on  tiic  value  m.  Then  we  may  vvn.o; 


h(in)  =  )  g(k)  h(nijt) 


(3.1) 


k=n 


..ur .  o;  it  l.-ide pendent  s  of  f(n)  the  probability  h(mjic) 

k-u.;..  -.v»nv'<.mit'on  of  f(n) ,  denoted  by  fK*(m).  The  quantity 


/*(.')  f(j)  t'*k‘  (m-j)  1/2 , . . . 


r— 


m=0 ,  +  1  ,+  2, . . . 


j  1  foi  m=0 

:°*W  -  •’ 

.  0  elsewhere 
Equation  {2.  i)  may  be  written: 


(3.2) 


h(m)  ~  ^  d(k)  fk  (hi) 
kr0 


(3.3) 


bU  >)  .  '.<) ,  .i  ,u 


w),  tilz),  and  F(r.)  be  the  u-transiorms  of  the  density  functions 
t(n),  respectively,  defined  by 
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H(z) 


00 

»Z  zmh(m)  , 


G(z)»Z  zkg(k) 
k=0 


(3.4) 


F(z) 


If  we  multiply  both  sides  of  Equation  3.3  by  zm  and  sum  over  all  m,  we 
obtain 


00  00  00 

Z  h(m)zm=XgW  Z 

k=0  m=-oo 


m«-oo 


(3.5) 


Using  the  definitions  given  in  Equations  3.4  and  the  fact  that  the  z-transform 
of  the  k-fold  convolution  of  a  probability  distribution  is  equal  to  its  z-transform 
raised  to  the  k^  power  we  may  write  Equation  3.5  as 


00 

n(z)  =Zg(k)  [F(z)]k  .  (3.6) 

k=Q 

The  definition  of  G(z)  allows  us  to  write  Equation  3.6  in  the  form 

H(z)  =  G[F(z)]  .  (3.7) 

Equation  3.7  is  our  basic  result.  It  shows  that  the  z-transform  of 
the  compound  distribution  may  be  obtained  by  taking  the  z-transform  of  the 
distribution  that  determines  the  number  of  samples  (the  sampling  distribution) 
and  replacing  every  z  by  the  z-transform  of  the  distribution  from  which  the 
samples  are  being  taken  (the  compounding  distribution). 
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The  demand  in  a  given  time  period  is  described  by  the  compound 
distribution,  h(m) ,  defined  by  Equation  3.3,  or  equivalently  in  transform  terms 
by  Equation  3.7,  if  the  number  of  customers  that  arrive  in  a  time  period,  k,  is 
described  by  the  density  function  g(k)  and  the  number  of  units,  n,  that  each 
customer  demands  is  independent  of  k  and  is  governed  by  the  density  function 
f(n) .  Although  n,  the  quantity  ordered  by  a  customer,  will  usually  be  positive, 
it  can  take  on  negative  values  if  customers  are  able  to  return  supplies  previously 
received  but  not  used. 

Moments  of  the  Compound  Distribution 

The  moments  of  the  compound  distribution  may  be  related  to  the 
moments  of  the  sampling  distribution  and  the  moments  of  the  compounding 
distribution.  To  obtain  this  relation,  let  us  recall  that  if  we  have  a  distribution 
f(n)  with  z-transform  F(z),  the  mean,  n,  second  moment,  n  ,  and  variance,  a*  # 
of  f(n)  are  related  to  the  derivatives  of  the  z-transform  F(z)  at  the  point  2?«1  by 
the  equations: 


n 


dFizl 

dz 


z*l 


F'(l) 


1 


^  Bd2Fjz) 

dz^ 


dF(zj 

dz 

z*=l 


z*  1 


F"(l)+F'(l) 


(3.8) 


and 

02  -  nz  -  n2  =  F" (1)  +  F'U)  -  [F'(1)J  2 

_  n 

The  mean,  m,  and  variance, q  ,  of  the  compound  distribution,  h(m),  may 

m 

then  be  obtained  as  follows; 
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H(z)  -  G  [F (z)] 

H'(z)  -  G'[F(z)]  F'(z) 

H'(l)  *  G*[F(1)]  F * ( 1)  .  (3.9) 

However, 

F (1)  *=  1  ,  (3.10) 

so  that  we  obtain 

H'(l)  «  G'WF'W 
or 

m  *=  it  n  .  (3.11) 

Equation  3,11  shows  that  the  mean  of  the  compound  distribution  is 
equal  to  the  product  of  the  means  of  the  sampling  distribution  and  the  compound¬ 
ing  distribution. 

2 

For  the  variance,  ,  we  first  compute 
H"  (z)  * 

■  G"[F(z)]  F'(z)  •  F*(z)  +  G'[F(z)]  F"(z) 

H"(l)*  G" (1)  [F'(l)]  2  +  G*(l)  F"(l) 

-  GH(l)n2  +  k  F"(l)  .  (3.12) 

The  variance  is  given  by: 


G'[F(z)]  F'(z) 


}' 
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0^  =  H" (1)  +  H*(l)  -  [H'(D]2 

-  G“  (1)  n2  +  it  F"(l)  +  k  n  -  k2  n2 
■  (0^  -  ic  +  it2]  n2  +  k  -  n  +  n2]  +  kn-k2  n2 

=  ii2  a2  +  k  o2  (3.13) 

We  see  from  Equation  3. 13  that  the  variance  of  the  compound  distribution  is 
equal  to  the  variance  of  the  sampling  distribution  multiplied  by  the  square 
of  the  mean  of  the  compounding  distribution  plus  the  variance  of  the  compound¬ 
ing  distribution  multiplied  by  the  mean  of  the  sampling  distribution. 
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IV.  RECURRENT  PROCESSES 


Introduction 

The  previous  chapter  discussed  the  theory  of  compound  distributions 
because  they  are  important  models  for  the  number  of  purchases  in  a  given  time 
period.  In  this  chapter  we  shall  investigate,  in  detail,  the  time  behavior  of 
demand  processes.  We  are  interested  in  counting  the  number  of  events  that 
occur  in  a  given  time  period  when  the  distribution  of  times  between  arrivals  does 
not  vary  with  the  passage  of  time.  The  results  of  the  chapter  show  that  the  dis¬ 
tribution  of  the  number  of  events  in  a  given  time  period  depends  on  the  definition 
of  the  time  interval  over  which  the  events  occur.  The  basic  theory  underlying 
the  type  of  demand  model  we  are  discussing  is  the  theory  of  recurrent  events. 

If  we  define  the  arrival  of  a  customer  to  be  an  event,  then  for  station¬ 
ary  processes  where  customer  arrival  times  are  independent  we  can  define  the 
density  function  of  the  time  between  successive  events,  or  the  interevent  time,  t, 
by  a(T).  By  repeated  sampling  of  the  density  function  a(-r)  we  can  construct  a 
realization  of  the  customer  arrival  process.  An  important  statistic  of  this  process 
is  the  number  of  events  in  a  given  time  interval.  To  define  this  statistic  precise¬ 
ly  it  is  necessary  to  specify  how  the  time  interval  is  placed  with  respect  to  the 
occurrence  of  events.  One  way  to  define  this  interval  is  to  say  that  it  begins 
immed.ately  after  the  occurrence  of  an  event  and  lasts  for  a  time  interval  t. 

Counting  from  an  Event 

Let  us  define  p(n,t)  to  be  the  probability  of  n  events  in  such  a  time 
Interval  t.  The  number  of  events  that  occur  in  a  time  interval  t  following  an 
event  will  be  n£  1  if  the  first  event  occurs  at  a  time  t  (T^t)  after  the  beginning 
of  the  Interval,  and  n- 1  events  occur  in  the  remaining  time  period,  t-t,  which. 
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of  course,  Is  initiated  by  an  event.  Since  the  occurrence  of  the  first  arrival  at  a 
time  t  represents  a  mutually  exclusive  set  of  events  for  different  values  of  T<t, 
and  since  the  occurrence  of  the  first  arrival  at  time  t  is  independent  of  the  occur¬ 
rence  of  the  remaining  arrivals  in  the  interval  t-T,  we  may  write 

4- 

L 

p(n, t)  =  \  a(T)  p(n-l,  t-T)  dr  ,  n>l  .  (4.1) 

0 

The  probability  that  there  will  be  n  events  in  a  time  interval  t  beginning  with  an 
event  is  thus  the  convolution  of  the  interevent  time  density  function,  a(T)#  with 
p(n-l,  t). 

Let  us  denote  by  P(n,  s)  and  A(s)  the  Laplace  transforms  of  p(n,t)  and 
a(T),  defined  by 

JO 

P(n,  s)  =  \  p(n,  t)  e~st  dt  -  L  [p(n,t)]  , 

0 

and  (4.2) 

JO 

A(s)  =  ^a(T)e  sTdr  *  L  [a(r)] 

0 

In  the  transform  domain,  the  convolution  of  two  functions  becomes  the  product  of 
their  transforms,  and  hence  Equation  4. 1  may  be  written  as  the  difference  equation 

P(n,  s)  =  A(s)  P(n-1,  s)  ,  nM  .  (4.3) 

The  solution  to  this  difference  equation  is 

P(n,  s)  =  P(0,  s)  [ A(s)]n  ,  n>l  .  (4.4) 

It  now  remains  to  find  P(0,  s),  the  transform  of  p(0,  t).  No  arrivals  will  occur  in  a 
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time  interval  t  beginning  with  an  event  if  the  time  until  the  next  event  r  is  greater 
than  t.  Hence,  we  may  write 

00 

p(0 ,  t)  =  j' a(T)  dT 
t 

t 

=  1  -  § a(T)  dT  .  (4.5) 

0 

Taking  the  Laplace  transform  of  Equation  4.5  we  obtain 

P(0,s)«-i-^  .  (4.6) 

Thus,  we  can  write  Equation  4.4  as 

P(n,s)  [l-A(s)]  [A(s)]n  n>0  (4^7) 

Equation  4.7  yields  the  Laplace  transform  of  p(n,t)  for  an  arbitrary  interevent  time 
distribution,  a(T). 

Counting  from  an  Arbitrary  Time 

Although  it  is  sometimes  important  to  count  events  in  a  time  period  be¬ 
ginning  with  an  event,  it  is  more  often  the  case  that  we  wish  to  count  events  begin¬ 
ning  with  an  initial  time  selected  in  a  more  general  way.  Let  us  suppose  that  count¬ 
ing  is  started  at  an  arbitrary  instant  such  that  the  time  to  the  next  event,  Tj,  has  a 
density  function  h(Tj).  This  density  function  h(r^)  is  generally  different  from  the 
tnterevent  time  density  function,  a(r).  Let  pA(n,t)  be  the  probability  that  n  events 
will  occur  in  a  time  interval  t  that  begins  at  such  an  instant.  Then  by  reasoning 
similar  to  that  used  in  obtaining  Equation  4.1  we  obtain 
t 

PA(n,t)  “JMtj)  p(n -  1 ,  t-Tj)  dTj  ,  n>l  .  (4.8) 

0 
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Equation  4.8  shows  that  the  probability  of  n  events  in  a  time  interval  t  starting 
at  an  arbitrary  point  in  time  is  given  by  the  convolution  of  the  density  function  for 
the  time  until  the  first  event,  h(T^),  with  the  probability  that  n-1  events  will  occur 
in  a  time  t  starting  after  an  event.  We  define  PA(n,s)  and  H(s)  to  be  the  Laplace 
transforms  of  pA(n,t)  and  h(T^) .  Then  Equation  4.8  may  be  written  in  the  transform 
domain  as 

PA(n,s)  =  H(s)  P(n-l,s)  ,  n>l  .  (4.9) 

If  we  substitute  the  result  of  Equation  4.7  into  Equation  4.9  we  obtain 

PA(n,s)  =  -J  H(s)  [  1  -  A(s)  ]  [A(s)]n_1  n>l  (4.10) 

Equation  4. 10  gives  the  transform  of  the  probability  pA(n,t)  for  n>  1.  It  remains 
to  find  the  transform  of  pA(0,t) .  By  reasoning  similar  to  that  used  for  Equation  4.5 
we  obtain 

t 

PA(0,t)  -  1-  ^h(Tj)  dTj  .  (4.11) 

*0 

The  Laplace  transform  of  Equation  4.11  is 

PA(0,s)  -■*  [l-H(s)]  .  (4.12) 

If  H(s)  =  A(s)  the  results  of  Equations  4. 10  and  4.12  agree  with  Equation  4.7. 

Counting  from  a  Time  Selected  at  Random 

Perhaps  the  most  important  case  of  counting  for  recurrent  processes 
arises  when  the  Initial  time  is  selected  independently  of  the  event  process;  a  situ¬ 
ation  most  often  called  starting  "at  random"  in  time.  This  way  of  starting  the 
process  will  imply  a  particular  form  of  h(r^) ,  the  density  function  for  the  time  until 
the  next  arrival,  and  so  is  a  special  case  of  the  arbitrary  starting  process  described 
above . 

Let  us  define  hg(T^)  to  be  the  density  function  for  the  time  until  the  first 
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event  from  a  time  selected  at  random,  and  let  HR(s)  be  its  Laplace  transform. 
Furthermore,  let  pR(n,t)  be  the  probability  of  n  events  in  a  time  t  starting  at 
random,  and  let  PR{n,s)  be  Its  Laplace  transform.  From  these  definitions  and 
Equations  4.10  and  4.12 


Hr(s)  [  1  —  A(s)  ]  [A(s)]n_1  ,  n  £  1 

PR(n,  s)  =*  (4.13) 

~  [1- HR(s)  ]  ,  n  =*0 


To  find  hR(r1)  we  first  recall  that  the  average  time  between  events,  r,  is 
given  by 


T 


(4.14) 


and  therefore  that  the  average  event  rate,  X,  is 


X 


(4.15) 


If  the  starting  point  is  selected  at  random,  the  next  event  will  occur  at  a  time 
between  Tj  and  Tj  +  dTj  if  an  event  occurs  in  the  interval  dTj  and  if  the  time 
between  this  event  and  the  preceding  event  is  greater  than  r^.  Since  the  prob¬ 
ability  of  an  event  in  any  short  time  interval  is  XdTj,  the  previous  statement  in 
probability  terms  is 

hR(Ti)  dTj  -  Xdr,:  Prob  interevent  time  >  j 

l  J 

00 

“  *dTi  a(r)  dT  , 

T1 

or 

r' 

hR(Tl)  «  X[  1  -  \  a(T)  dT)  .  (4.16) 

0 
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Equation  4.16  is  an  explicit  expression  for  hR(r^)  in  terms  of  the  interevent  time 
density  function  a(T).  The  Laplace  transformation  of  Equation  4.16  is 

Hr(s)  =  ~  [  1  - A(s)  ]  .  (4.17) 

Finally,  substitution  of  Equation  4.17  into  Equation  4.13  yields 


f  A  [  l-A(s)]2  [A(s)]n-1  ,  n2>l 

i  sz 

P^(n,  s)  =‘ 

j  -^  [  s  -  X  +  XA(s)  ]  n  =0 


(4.18) 


Bivariate  Transform 

It  is  often  useful  to  transform  with  respect  to  the  discrete  variable,  n, 
m  our  probability  expressions  as  well  as  vith  respect  to  the  continuous  variable  t, 
i.e. ,  it  is  useful  for  calculating  the  moments  of  the  distribution  of  the  number  of 
events  in  a  time  interval  t.  Let  us  define  the  bivariate  transform  Pb(z,s)  of  p(n,t)  by 

00  00 

Pb(z,s)  =  ^  zn  j  p(n,t)  e~st  dt 
n=0  0 


=  Yj  zn  P(n,  s) 
n=0 

For  P(n,s)  given  by  Equation  4.7  we  have 


(4.19) 
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For  counting  from  a  random  time  we  can  substitute  Equation  4.17  for  H(s)  in 
Equation  4.21 
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(z,s) 


l-“[  l-A(s)]  -  zA(s)  +  z“[  l-A(s)  ] 
s[  l-zA(s)  ] 

s-X  +  XA(s)  -  zsA(s)  +  zX  -  zXA(s) 
”  s2[  l-zA(s)  ]  ~” 

(s-X  +  zX)  +  A(s)  [  X-zs-zX] 

_ 

s  [l-zA(s)] 


(4.22) 


Use  of  the  Bivariate  Transform  to  Calculate  Moments 

The  bivariate  transform  Pb(z,s)  is  an  important  quantity  because  it  may 
be  used  to  determine  all  the  moments  of  the  distribution  of  the  number  of  events 
in  time  t.  In  particular,  the  Laplace  transform  of  n(t),  the  expected  number  of 
events  in  time  t,  is  found  by  evaluating  the  derivative  of  P  (z,s)  with  respect 
to  z  at  the  point  z=l.  This  is  shown  as  follows 


oe  oo 

Pb(z,s)  ®  V  zn  y  p(n,t)e  stdt 
n=0  0 


00  00 

3  _b.  .  V  n-1  f  ,  .  _stj* 
—  P  (z,s)  *  _  nz  \  p(n,t)e  dt 

n=*0  0 


£-Pb(z,s)j 


Z=1 


np(n,t)dt 


=  L  [  n(t)  ] 


(4.23) 
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For  a  recurrent  event  process  starting  after  an  event  we  may  calculate 
the  Laplace  transform  of  the  expected  number  of  events  from  Equation  4.20  as 


■•nd 


j.  pb(Z/S)  i  idm 

s[l-zA(s)] 


Ltn(tf1.^Pb(Z'S)|  =i-s[^(s), 


(4.24) 


Similarly,  for  a  process  starting  at  an  arbitrary  time  we  may  use  Equation 
.21  to  obtain  the  expected  number  of  events  in  a  time  t,n^(t),  as  follows 


iPb(z,s),msiuiAuu. 

9  A  s  [  l-zA(s)  ]2 


L[nA(t)1  *  ^PA(z's) 


_H(sL 


z=l 


S[  l-A(s)  ] 


(4.25) 


Finally,  to  calculate  the  Laplace  transform  of  the  expected  number  of 
time  t  for  a  process  starting  at 
E  luation  4.17  into  Equation  4.25  to  obtain 


••ents  in  a  time  t  for  a  process  starting  at  random,  nR(t),  we  substitute  HR(s)  from 


L[nR(t)] 


(4.26) 


If  we  take  the  inverse  transform  of  Equation  4.26  we  find  that 


nR(t)  =  At 


(4.27) 
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Equation  4.27  is  a  particularly  important  result  because  it  shows  that  the  expected 
number  of  events  in  a  time  t  starting  at  random  is  equal  to  the  product  of  the 
average  event  rate,  X,  and  the  time  interval  t  and  thus  depends  only  upon  the 
mean  of  the  interevent  time  distribution. 

This  chapter  has  summarized  the  theory  relevant  to  the  counting  of 
recurrent  events  with  particular  emphasis  on  the  importance  of  the  starting  point 
of  the  period.  This  theory  will  be  utilized  in  discussing  the  compound  dis¬ 
tributions  used  to  describe  demand. 


V.  COMPOUND  POISSON 


Introduction 


The  compound  Poisson  distribution  is  a  family  of  compound  distribu¬ 
tions  of  special  importance  in  inventory  control  theory.  In  this  chapter  we 
shall  develop  the  properties  of  the  compound  Poisson  family  and  show  how  such 
commonly  used  distributions  as  the  stuttering  Poisson  and  negative  binomial 
may  be  interpreted  as  compound  Poisson  distributions.  Finally,  the  ppint  is 
made  that  the  assumption  of  independent  demand  in  independent  intervals, 
common  in  inventory  analyses,  implies  a  demand  distribution  of  the  compound 
Poisson  type. 

The  Regular  Poisson  Process 


The  Poisson  process  may  be  described  as  a  recurrent  event  process 
where  the  interarrival  time  distribution,  a(-r),  is  exponential  in  form, 

a (t)  «=  Xe'Xr  .  (5.1) 

The  Laplace  transform  of  this  distribution  is 


A(s) 


X 

s+X 


(5.2) 


We  are  interested  in  the  number  of  customers  that  will  arrive  in  a  time  t. 
Chapter  IV  shows  that  this  probability  generally  depends  on  the  placement  of 
the  time  interval.  In  particular,  Equation  4.7  gives  the  Laplace  transform  of 
the  probability  that  n  customers  will  arrive  in  a  time  t  following  a  customers' 
arrival,  p(n,t).  Since  we  are  dealing  with  a  Poisson  process  we  substitute 
Equation  5 . 2  into  Equation  4 . 7  and  write 


P(n,s)  *= 


(s+X)n+1 

5  -  1 


n  >  0 


(5.3) 


Finally,  inverse  transformation  yields 

>n  -At 

p(n,t) 


n! 


(5.4) 


Equation  5.4  is  an  expression  for  the  probability  that  n  customers 

arrive  in  a  time  t  following  an  arrival  of  a  customer.  If  counting  is  begun  at 

random  then  Equation  5 . 2  must  be  substituted  into  Equation  4 . 18  to  yield 

P  (n,si  the  transform  of  the  probability  that  n  customers  will  arrive  in  a  time 
K 

t  following  a  point  at  random;  the  result  is 


or 


PR(n,s) 


PR(n,s)  « 


(s+A) 


n+1 


n  _>  x  . 
n=  0  , 


n>,0  .  (5.5) 


Note  that  Equation  5.5  is  the  same  as  Equation  5.3  and  therefore  p(n,t)  =  pR(n,t), 
and  we  obtain  the  same  probabilistic  behavior  of  the  process  for  both  event- 
determined  starting  times  and  random  starting  times. 


The  bivariate  transform  of  p(n,t)  =  p  (n,t)  is  given  by 

K 


Pb(z,s) 


PR(z,s) 


10 

■X  * 


n=0 


(s+A) 


n+1 


oo 


1 

s+A  -  zA 


(5.6) 
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Definition  of  the  Compound  Poisson  Process 


The  compound  Poisson  distribution  arises  in  a  demand  situation 
when  customers  arrive  at  random  according  to  a  Poisson  process  and  then 
purchase  a  number  of  units,  n,  governed  by  a  discrete  density  function,  f(n). 

The  probability  that  k  customers  will  arrive  in  a  time  t  if  the  average  customer 
arrival  rate  is  X  is  obtained  from  Equation  5.4  as 


g(k)  = 


/  v .  \  k  —  Xt 

fofl  e 

k! 


(5.7) 


The  number  of  purchases,  m,  that  will  be  made  in  a  time  t  is  then  governed  by 
the  compound  Poisson  density  function  determined  by  the  Poisson  sampling 
function,  g(k),  and  the  arbitrary  compounding  distribution,  f(n). 

According  to  Equation  3.7  the  z-transform  of  the  compound  distribu¬ 
tion,  H(z),  is  related  to  the  z-transform  of  the  sampling  distribution,  G(z), 
and  the  z-transform  of  the  compounding  distribution,  F(z),  by 

H(z)  =  G[F(z)]  .  (5.8) 

The  z-transform  of  the  Poisson  sampling  distribution  is  obtained  using 
Equation  5 . 7  as 


or 


G(z)  =  e 


-Xt(l-z) 


(5.9) 


Therefore,  for  an  arbitrary  compounding  distribution  f(n)  with  z-transform  F(z), 
the  z-transform  of  the  compound  Poisson  distribution  of  purchases,  H(z,t)»  is 
given  by 


H(z,t)  =  e-Xtt1-F(z)I 


(5.10) 
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The  Regenerative  Property  of  the  Compound  Poisson 


Many  interesting  properties  of  the  compound  Poisson  distribution  as 
a  demand  model  may  be  derived  from  Equation  5.10.  Suppose,  for  example, 
that  we  have  one  compound  Poisson  demand  process  with  customer  arrival  rate  X, 
and  a  compounding  distribution  of  individual  customer  purchases,  f^(n),  whose 
z-transform  is  given  by  F^(z).  Suppose  also  that  we  have  a  second  compound 
Poisson  demand  process  with  corresponding  properties  X^,  f£(n),  anc*  ^(z)* 

If  the  processes  are  independent,  then  the  z-transform  of  the  probability  density 
function  of  the  total  purchases  in  time  t  is  given  by 

H(z)  *  H1(z)H2(z)  -  e'Xltll"Fl(z)}  e“V[1“F2(z)1  .(5.11) 


Let  us  investigate  under  what  conditions  Equation  5.11  also 
represents  a  member  of  the  compound  Poisson  family.  We  may  write  Equation  5. 11 
in  the  following  way 


or 


H(z)  ■=  exp  -<vy<  i> Fi<*>  T. 


(z)] 


(5.12) 


H(z)  =  exp  -(X1+X2)t[l  -  F(z)]^  .  (5.13) 

We  see  that  Equation  5. 13  represents  a  compound  Poisson  process  with  a 
customer  arrival  rate  equal  to  the  sum  of  the  rates  of  the  two  original  processes 
and  with  a  compounding  distribution  whose  z-transform,  F(z),  Is  the  transform 
of  the  sum  of  the  two  original  compounding  distributions,  weighted  by  their 


respective  arrival  rates;  that  is, 
F(z) 


\  X2 
X.+X,  Fl^z)  +  X+X„  F2(z) 


1  2 


1  2 


(5.14) 
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Therefore  we  have  shown  that  the  sums  of  compound  Poisson  processes  are 
compound  Poisson  processes. 

A  demand  model  for  which  the  result  expressed  by  Equation  5. 13 
is  relevant  is  the  model  for  the  physical  situation  where  two  groups  of 
customers  with  different  arrival  rates  and  purchasing  characteristics  purchase 
the  same  item.  For  example,  destroyers  and  aircraft  carriers  will  have  quite 
different  arrival  and  purchase  characteristics  for  certain  types  of  vacuum 
tubes. 


Moments  of  the  Compound  Poisson  Distribution 


The  moments  of  the  compound  Poisson  distribution  are  easily 
obtained  from  the  results  of  Chapter  III.  The  mean  and  variance  of  the  number 
of  customer  arrivals  in  a  time  t  for  the  Poisson  sampling  distribution  of 
Equation  5.7  are 


(5.15) 


The  mean  number  of  purchases  in  time  t,  m,  is  obtained  from  Equation  3.11 
as 


m  =  Atn  ,  (5 . 16) 

while  the  variance  is  given  by  Equation  3.13  as 

2-2  2 

o„  =  n  At+Atn 
m  n 


“  At  (n2+  (t2) 
cn 

=  At  n2  (5.17) 
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We  thus  see  that  the  mean  and  the  variance  of  the  compound  Poisson  distribu¬ 
tion  are  proportional  to  only  the  first  and  second  moments  respectively  of  the 
compounding  distributions. 


A  parameter  that  is  often  used  to  describe  demand  distributions  is  the 
variance-to-mean  ratio,  R  ,  defined  by 


(5.18) 


If  we  use  Equations  5. 16  and  5.17  we  see  that  for  the  compound  Poisson 


R 


(5.19) 


We  shall  now  show  that  the  variance-to-mean  ratio  for  the  compound  Poisson 
must  be  greater  than  or  equal  to  one,  if  n  is  positive.  The  first  and  second 
moments  of  the  compounding  distribution  are  defined  by 


(5.20) 


and 


2 

n 


n2  f(n) 


n=-cc 


Consider  the  difference  n 


2 


n  . 


We  may  write 


(5.21) 
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n  = 


nf(n) 


2 

n 


OO  00 

Z  n2fW-  Z 

n=-oo  n^-oo 


00 

=  X  (n2-n)f(n) 
n=-oo 

00 

=  n(n -  1)  f (n)  (5.22) 

n=-oo 

Since  the  product  n(n-  1)  is  always  greater  than  or  equal  to  zero  for  any  integral 
value  of  n  and  since  f (n)  can  never  be  negative  it  follows  that 

~2  -  n 
n  -  n  >  0 

n2>n  , 

and  finally,  since  n  is  positive  by  assumption,  we  find  from  Equation  5. 19 

R  >  1  .  (5.23) 

This  completes  our  discussion  of  the  properties  of  the  compound 
Poisson  distribution.  The  sections  following  describe  certain  special  members 
of  the  compound  Poisson  family  that  have  been  suggested  for  demand  models. 

The  Geometric  Poisson  and  the  Stuttering  Poisson  Distributions 

Introduction 

Two  distributions  that  are  often  used  for  describing  demand  in 
inventory  systems  are  the  "stuttering"  Poisson  and  the  geometric  Poisson 
distributions.  It  is  of  interest  to  examine  the  exact  interrelationship  between 
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these  distributions  in  order  to  determine  how  results  of  analyses  based  on  one 
of  the  distributions  may  be  modified  to  be  applicable  to  systems  analysed  using 
the  other. 

The  stuttering  Poisson  distribution  refers  to  an  arrival  process  where 
interarrival  times  are  exponentially  distributed  except  that  there  is  a  finite 
probability  of  a  zero  interarrival  time  represented  by  an  impulse  at  the  origin 
of  the  interarrival  time  density  function.  If  we  consider  each  arrival  as  a 
single  demand  on  the  system,  then  the  impulse  in  the  interarrival  density  function 
will  cause  a  "clumping"  of  arrivals  and  hence  a  clumping  of  demand  that  would 
not  be  present  if  an  interarrival  time  of  zero  had  zero  probability.  (The  simple 
Poisson  process  is  this  special  case  of  the  stuttering  Poisson.)  As  a  result  the 
stuttering  Poisson  is  sometimes  a  useful  model  for  systems  where  multiple  orders 
can  occur. 

The  distribution  allows  clumping  of  orders  in  a  conceptually  different 
way.  For  this  distribution  the  interarrival  time  density  function  is  a  pure  ex¬ 
ponential,  but  each  arrival  when  it  occurs  generates  a  demand  by  sampling  from 
a  geometric  distribution.  The  question  arises  as  to  how  the  clumping  of  demand 
caused  by  this  distribution  differs,  if  at  all,  from  that  caused  by  the  stuttering 
Poisson. 

Analysis 

To  examine  this  question  let  us  examine  each  distribution  in  more 
detail,  beginning  with  the  stuttering  Poisson  distribution.  For  the  stuttering 
Poisson,  the  interarrival  time,  r,  is  zero  with  probability  p  and  is  selected 
from  a  density  function^  with  probability  1-p,  so  that  a(<r),  its  density 
function,  is  given  by 

a(T)  =  p6  (t)  +  (l-p)p.e  ,  (5.24) 
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where  5  (t)  represents  a  unit  Impulse  at  t=0.  The  Laplace  transform,  A(s), 
of  this  density  function  is  then 

A(s)  *=  p  +  (5.25) 

s+^t 

The  mean  arrival  rate  is  given  by  Equation  4.  15  as 


X  = 


_1 _ 

A'  (0) 


$ 


and  hence 


X  = 


The  probability  that  n  customers  will  arrive  in  a  time  t  beginning 

Id 

with  an  arrival  has  a  bivariate  transform,  Pu(z,s),  given  by  Equation  4.20  using 
the  A(s)  from  Equation  5.25  above. 


Pb(z,s) 


A-p . 

S+Ji-  szp  -\IZ 


(5.26) 


If  p  is  chosen  to  be  zero  then  the  stuttering  Poisson  distribution  becomes  the 
regular  Poisson  distribution  with  arrival  rate  fi,  for  which  P(z,s)  ■  lAs+ji-pz) , 
as  indicated  by  Equation  5.6.  Equation  5.26  is  thus  verified  for  this  particular 
case. 


The  Laplace  transform  of  the  expected  number  of  demands  in  a  time  t, 
n(t),  is  obtained  by  using  Equation  4.24. 


and  inverse  transformation  yields 


(5.27) 

(5.28) 
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The  expected  number  of  demands  in  time  t  therefore  has  a  component 
that  increases  linearly  with  time  at  a  rate  ^/(1-p)  which  is,  as  we  found  earlier, X. 
It  also  has  a  constant  component,  p/(l-p),  so  that  the  expected  number  of 
purchases  in  time  zero  is  equal  to  p/(l-p).  This  is  a  disquieting  feature  of  the 
stuttering  Poisson,  but  let  us  proceed  to  our  examination  of  the  geometric  Poisson 
before  considering  this  fact  further.  If  the  geometric  Poisson  also  has  a  bivariate 
transform  P(z,s)  given  by  Equation  5.26,  then  it  will  be  equivalent  to  the 
stuttering  Poisson  as  a  demand  distribution.  If  it  does  not,  then  we  shall  have 
to  understand  the  difference. 

The  geometric  Poisson  distribution  is  a  member  of  the  general  compound 
Poisson  family.  The  geometric  Poisson  is  a  compound  Poisson  distribution  where 
the  compounding  distribution  f(n)  is  given  by  the  geometric  distribution 

f(n)  *  (l-p)pn  1  n>  1 

0  otherwise  . 

Note  that  each  arrival  must  create  at  least  one  demand.  The  generating  function 
F(z)  is  obtained  using  Equation  3.4  as 

S'  S 

F (z)  =  ^  f (n)  zn  =  ^  (1-p)  pn  1  zn  *  tj.TPl?  #  (5.29) 

n=0  n=  1  1_PZ 

If  we  assume  that  the  Poisson  sampling  process  has  the  average  arrival  rate  n, 
then  Equation  5.  10  can  be  written  as 

H(z.t)  = 

and  for  the  compounding  distribution  of  Equation  5.29  we  find 

.  r  i  (1-p)z  i  .  1-z  . 

H(z,t)  =  e"^  ‘  1-pz  1  =  e-^  1-pz  1  .  (5.30) 
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The  bivariate  transform  Pb(z,s)  of  p(n,t)  is  given  by 


P  \Z /  s)  =  L[H(z,t)] 


(5.31) 


and  so 


P  (z,s)  = 


1 


1-pz 


s+n 


l-z  S+fi-SZp-JiZ 


(5.32) 


1-pz 


Membership  of  the  geometric  Poisson  distribution  in  the  compound  Poisson 
family  makes  it  unnecessary  to  specify  whether  the  time  interval  during  which 
arrivals  are  counted  is  begun  after  an  arrival  or  at  random,  in  accordance  with 
the  following  reasoning.  Because  the  sampling  distribution  for  a  compound 
Poisson  process  is  the  simple  Poisson  process,  it  is  invariant  to  counting 
beginning  at  random  or  after  an  event,  as  shown  earlier.  Since  the  probability 
of  n  demands  in  time  t  depends  only  on  the  sampling  distribution  and  the  time 
invariant  compounding  distribution,  the  counting  interval  for  compound  Poisson 
process  may  be  begun  after  an  event  or  at  random  with  the  same  result. 

The  quantity  P  (z,s)  as  given  by  Equation  5.32  again  reduces  to  the 
bivariate  transform  for  the  simple  Poisson  distribution  when  p=0.  Notice  that 
the  denominator  of  this  expression  is  the  same  as  that  of  Equation  5.26; 
however,  ihe  numerator  is  different.  Let  us  compute  the  expected  number  of 
demands  in  time  t  for  the  geometric-Poisson  using  Equation  4.23  and  P^(z,s) 
as  given  by  Equation  5.32.  Thus, 


L!n(t)l  pb(z ,  s) 

d  Z 


and 


1  =  -2- 

1  1-pz  l 

i  ~  dz 

1  z  i 

1  s+p-szp-pz  1 

z*»  1 


y/ihp) 

02 


"(l)  * 


(5.33) 


(5.34) 


The  expected  number  of  arrivals  in  time  t  for  the 
distribution  has  the  same  linear  growth  term  n/(l-p)  *  X,  as  that  for  the 
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stuttering  Poisson  given  by  Equation  5.28;  however,  it  does  not  have  the 
constant  term  p/(l-p).  Since  we  would  not  expect  this  constant  to  appear  on 
physical  grounds,  we  may  ask  if  we  can  modify  the  stuttering  Poisson  to 
eliminate  this  term.  Perhaps  when  this  is  done  PD(z,s)  and  hence  p(n,t)  will 
be  the  same  for  both  distributions. 


The  difference  between  the  distributions  is  apparently  caused  by 

the  finite  probability  of  purchase  for  the  stuttering  Poisson  at  t=0.  If  this 

were  eliminated  by  requiring  that  the  first  arrival  not  be  instantaneous,  then 

it  is  possible  that  the  two  distributions  would  agree.  The  finite  probability  of 

arrivals  in  an  interval  of  zero  length  is  in  fact  caused  by  beginning  the 

counting  process  after  an  arrival  occurs.  One  way  to  eliminate  this  difficulty 

is  to  begin  the  process  at  a  random  time.  If  this  is  done  then  p  (n,t),  the 

K 

probability  of  n  arrivals  in  a  time  t  beginning  at  random,  has  a  bivariate 
transform  given  by  Equation  4.22  rather  than  by  Equation  4.20.  If  we  use 
A(s)  as  defined  by  Equation  5.25.  then 


p£(z,s) 


1-pz 

S+fi  -  szp  -  \iz 


(5.35) 


in  complete  agreement  with  P^(z,s)  for  the  geometric  Poisson  as  given  by 
Equation  5.32. 


Thus  we  have  shown  that  if  we  are  interested  in  demand  generated 
during  a  time  period  beginning  at  random,  the  stuttering  Poisson  and  the 
geometric  Poisson  are  identical. 


The  Negative  Binomial  Distribution 
Introduction 

The  negative  binomial  distribution  has  often  been  suggested  as  a 
model  for  demand  processes.  This  section  will  show  how  several  different 
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probabilistic  models  will  lead  to  a  stochastic  process  governed  by  the  negative 
binomial  distribution. 

Distribution  of  First  Success  in  a  Sequence  of  Bernoulli  Trials 

The  first  model  we  shall  discuss  is  based  upon  a  sequence  of 
Bernoulli  trials.  Suppose  that  we  have  such  a  sequence  with  probability  of 
success,  p,  and  probability  of  failure,  q=l-p.  Let  f(k;r,p)  be  the  probability 
that  the  rth  success  will  occur  on  trial  r  +  k.  Then  f(k;r,p)  is  also  equal  to 
the  probability  that  k  failures  will  take  place  in  r+k-1  trials  and  a  success  will 
take  place  on  the  (r+k)th  trial.  It  follows  then  that  f(k;r,p)  is  given  by 


,,,  ,  r+k-T  r-1  k 

f(k;r,p)  =  k  p  q  •  P  , 

k  2^0  , 

(5.36) 

r/t  \  r+k-1'  r  k 

f  (k;r ,  p)  =  k  ;  P  q 

k?0  . 

(5.37) 

With  some  manipulation.  Equation  5.37  can  be  placed  in  the  form  often  seen 
for  the  negative  binomial  distribution.  To  see  this  let  us  investigate  the 
combination  of  a  objects  taken  b  at  a  time.  By  definition,  we  have 


a  _  a  1  _  a(a-l) . . .  (a-b+1) 

b  b!  (a-b)  I  b  I 

0 


a>  b 


(5.38) 


a<  b  or  b'O . 


We  may  replace  a  by  -a  and  extend  the  definition  to  obtain 

-a(-a- 1) . .  .  (-a  -b+l) 

"b'=  bI 

,  nb  a(a+l) .  .  .  (a+b- 1) 

=  b! 


=  (-1) 


b  a+b- 1 


(5.39) 
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or 

a+b~l  /  l\b  “a  lr 

b  =  (-1)  b  .  (5.40) 

Using  Equation  5.40  we  may  rewrite  Equation  5.37  as 

f(k;r,p)  =  (-l)k  ~r  pr  qk  .  (5.41) 

Finally,  we  obtain 

f(k;r,p)  •=  “r  pr  (-q)k  .  (5.42) 

Equation  5.42  represents  a  commonly  used  form  of  the  negative  binomial 
distribution;  it  is  the  form  responsible  for  the  name  of  the  distribution.  We 
have  seen  that  f(k;r,p)  may  be  interpreted  as  the  probability  that  in  a  sequence 
of  Bernoulli  trials  with  probability  of  success,  p,  the  r^1  success  will  occur 
on  the  (r+k)t*1  trial.  An  interesting  special  case  is  the  one  where  r  is  set 
equal  to  1;  then,  f(k;l,p)  is  the  probability  that  the  first  success  will  occur 
on  trial  k  +  1.  This  quantity  is  given  by 

f(k;l,p)  =  pqk  ,  k-0  .  (5.43) 

We  recognize  Equation  5.43  as  the  expression  for  the  probability  density 
function  of  a  geometric  distribution.  Note  that  this  geometric  distribution  has 
a  non-zero  probability  for  the  value  k*=0r  unlike  the  geometric  distribution 
discussed  above.  Let  us  define  F(z;r,p),  the  z-transform  of  the  negative 
binomial  distribution,  by 

F(z;r,p)c^  zk  f(k;r,p)  .  (5.44) 

k=0 
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Then  for  r~l  the  z-transform  is  given  by 


F(z;l,p)  =  L  zk  pqk=  j-Z—  .  (5.45) 

k=0  "  qZ 

Now  that  we  have  the  z-transform  of  the  geometric  distribution,  we  can  find  its 

mean  and  variance.  Its  mean  is  given  by  the  derivative  of  its  z-transform  at 

the  point  z=l.  Let  us  denote  the  mean  of  the  negative  binomial  by  k(r,  p),  its 
~2  2 

second  moment  by  (r,  p)  and  its  variance  by  a^(r,  p).  Then  using  Equation 
5.45,  we  have 

k(1/P^Sdz  F(z;1'p)  “  #  (5.46) 

z=l 

—  2  2 

k2(l.p)=“^  F(z;l,p)j  +  k(l,  p)  =  2q2+qp  ,  (5.47) 

d2  ! z=l  p 

and 

a^(l,  p)  =  k2(l,p)  -  [  k(l,  p)]  2  =  q/p2  (5.48) 

as  the  basic  moments  of  the  geometric  distribution. 

Let  us  now  find  the  z-transform  of  the  general  negative  binomial. 

Combining  Equations  5.37  and  5.44,  we  obtain 


00 

F(z;r,  p)  “X  zk  (r+k"l)  pr 
k=0  >■  k  ' 


or 


F(z;r,  p)  =  p' 


CV  ,  * 

I  IT 

k=0 


(qz) 


(5.49) 


(5.5  0) 


To  obtain  F(z;r,  p)  let  us  examine  the  following  relations.  From  the  binomial 
theorem  we  have 

CU 

fW-Xif'.-'fc’  . 

j  =  o'  ' 


(5.51) 


Recall  that  as  defined  by  Equation  5.38  is  zeio  for  jyn  and  jzO.  If  n  is  replaced 
by  -n  the  binomial  theorem  is  defined  by 


(a+b)’ 


n  =V  (-m  a-n 

j’O  1 


-H-j  bJ 


(5 .  5  2) 
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Equation  5.39  allows  us  to  write  Equation  5.52  in  the  form 


CO 

(a+b)~n  S  n+^_1  a"n"J(-b)J  .  (5.53) 

j=0  } 

If  in  Equation  5.53,  we  take  a=l,  b=-qz,  n=r,  and  j=k,  then  the  result  is 

00 

Yj  r+k_1  (qz)k  =  (l-qz)”r  ,  (5.54) 

k=0 

and  thus  F(z;  r,p)  may  be  expressed  in  closed  form  by 

F(z>r,p)  =  q”}7  .  (5.55) 

We  have  obtained  in  closed  form  the  z-transform  of  the  general  negative 
binomial  distribution. 

Distribution  of  the  Sum  of  Samples  from  a  Geometric  Distribution 
It  is  informative  to  write  Equation  5.55  in  the  form 

F(z;r,p)  =  [F(z;l,p)]r  (5.56) 

by  using  Equation  5.45.  We  see  that  the  z-transform  of  the  negative  bonomial 
distribution  can  be  expressed  as  the  r^1  power  of  the  z-transform  of  the 
geometric  distribution.  It  follows  that  the  negative  binomial  distribution  with 
parameter  r  may  be  interpreted  as  the  distribution  of  the  sum  of  r  independent 
samples  from  the  geometric  distribution  expressed  by  Equation  5.43. 


The  moments  of  the  negative  binomial  distribution  are  calculated 


from  its  z-transform  as  follows: 


k(r'p)=d7  F^Z;r,p^  =  r(q/p)  , 

2=1 


(5.57) 


k2(r,p)-  ^  Ffar.p)  +  Mr,p)  -  ,  (5.58) 

dz  .  P 

z=l 


and 


(r,p)  =  k2(r,p)  -  [ k (r ,  p) ]  2  =  r(q/'p2) 


(5.59) 


We  see  that  these  results  not  only  agree  with  those  of  Equations  5.46, 
5.47,  and  5.48  when  r=l,  but  also  that  they  support  our  contention  that  the 
negative  binomial  distribution  may  be  interpreted  as  the  sum  of  independent 
samples  from  the  same  geometric  distribution.  Thus,  the  mean  of  the  negative 
binomial  is  r  times  the  mean  of  the  underlying  geometric  distribution,  while 
tne  variance  of  the  negative  binomial  is  r  times  the  variance  of  the  geometric. 

We  have  now  obtained  two  completely  equivalent  expressions  for 
the  negative  binomial  distribution  given  by  f(k;r,p).  First,  it  represents  the 
probability  that  in  a  sequence  of  Bernoulli  trials  with  probability  of  success  p, 
the  rtn  success  will  occur  on  the  (r+k)1^  trial.  Second,  it  represents  the 
probability  that  the  sum  of  r  independent  samples  from  a  geometric  distribution 
wi.h  parameter  p  will  cake  on  the  value  k.  Let  us  now  proceed  to  another 
process  that  gives  rise  to  a  negative  binomial  distribution. 

Poisson  Demands  wUh  Erlang  Arrival  Rates 

Suppose  that  the  demand  for  a  product  in  a  given  time  interval  of 
length  t  is  Poisson- distributed  with  mean  race  A.  Then  the  probability  of  n 
demands  in  the  period,  d(nUt),  is  given  by 
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(5  .  bO) 


dfeN 


n  -At 


Suppose  further  that  Ine  demand  rate.  A,  in  successive  periods  of  lenoth  t 
is  determined  by  independent  samples  from  the  density  function  g(A)  defined 


.k  k  - 1  -k A|; 

u(As  =  &il_A - i 

(k- ))  I 


.b  1} 


That  is,  the  demand  rales  from  period  o  period  ere  chosen  from  a  k  phase 

Erlang  distribution  witn  mean  ^  .  Of  course,  as  k  becomes  infinite  g{A) 

1  r 

tends  to  a  unit,  impulse  ai~  ,  and  the  demand  process  will  be  a  simple 

**  i 

Poisson  wmi  mean  rare  A  =  ~  in  each  period.  Le>.  cl(n,c)  be  the  probability 
that  n  units  are  demanded  in  a  given  period  of  iengtn  t.  Then  d(n,t)  is  given 


r  *n  -At  ...  k.k-1  -kAii 
d(n,J  »  \  d(njAt)  g(A)  dA  *  j  (k-T)f - 


(ku)*  i*-  vn+k-1  At  ...  . 

d(n,t)  “  i)  Jc*  j  (At)  e  t  c(\t) 


(5  . 3) 


Using  tne  gamma  function  integral  expressed  by 


s  *=Ssrt- -sir 


(5 .  c  4) 


we  ostein 


d  (n ,  ) 


n !(k- 1) !  r” 


„  (n+k-f)l  n  K 
(Hkp)'  'K 


11  n  .  k 

n+k- 1  _t _  ku 

n  t+fy  t+kfi 


Comparison  of  Equation  5.65  with  Equation  5.37  shows  that  the  number  of 
demands  in  a  time  interval  of  length  t  is  given  by  a  negative  binomial 
distribution.  The  parameter  r  of  the  negative  binomial  is  the  number  of 
phases,  k,  in  the  Erlang  distribution;  the  probability  of  success,  p,  for  the 


negative  binomial  is  given  by 


k/j 


t+kp 
d(n,t)  =  f(n;  k, 


Thus  we  have 


t+kfi 


(5.66) 


We  have  thus  shown  that  if  demand  in  successive  time  intervals  is 
Poisson  with  mean  rates  selected  as  independent  samples  from  the  Erlang 
distribution,  then  the  number  of  demands  in  a  particular  interval  will  be 
distributed  according  to  the  negative  binomial  distribution.  Such  a  distribution 
could  arise  in  the  Navy  Supply  System,  for  example,  if  the  number  of  ships 
in  port  at  any  particular  time  followed  the  Erlang  distribution,  and  each  ship 
generated  demands  according  to  the  same  Poisson  distribution.  The  total 
quantity  demanded  of  the  Navy  Suppiy  System  would  then  be  distributed  according 
to  the  neaative  binomial  distribution. 


The  Negative  Binomial  as  a  Compound  Poisson 

Still  another  model  of  the  negative  binomial  is  based  on  the  compound 
Poisson  distribution.  Suppose  that  arrivals  are  governed  by  a  Poisson  process 
with  mean  rate  \  and  that  when  each  arrival  occurs  demand  is  generated  as  a 
sample  from  a  discrete  distribution  f(n)  with  z-transform  F(z).  From  the  theory 
of  the  compound  Poisson  distribution  developed  above,  we  have  from  Equation  5.10 
that  the  z-transform  of  the  number  of  demands  in  time  t  is 

H(z,t)  =  e"Xt[1_F(z)1  (5.67) 
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li  tne  compound  Poisson  demand  is  to  be  governed  by  a  negative  binomial 
distribution  with  parameters  r  and  p,  then  its  z-transform  must  also  be  given 
oy  Equation  5.55.  Hence,  if  we  set  Equation  5.55  equal  to  Equation  5.67  we 
me',  sotve  for  F(zl  ,  the  z-transform  ol  the  required  compounding  distribution. 
Thus,  we  write 


y-Ati  l-F(z)]  _  p 

1-qz 


(5 . 68) 


and  solve  for  F(z).  Inversion  of  the  z-transform  F(z)  will  then  yield  the  analytic 
expression  for  the  compounding  distribution  inquired  in  the  compound  Poisson 
so  tnat  total  demand  will  bo  given  by  the  negative  binomial  distribution. 
Proceeding  algebraically,  we  obtain 


-Xt[l-F(z)]  *  rln  p - rln(l-qz) 
i-F(2)  *  ~  in  ln(l-qz) 


F(z)  »  i  +  inp  -  ~  In  (i-qz) 


(5.69) 


Using  the  logarithmic  expansion 


„n 


-ton--**  L  t 

n=  1 


we  may  rewrite  Equation  5.69  es 


<*»  >1 


it .  70) 


r/-l  ^  t  >  — •  i  i--  \  (asl 
FUJ  -  1  •*  —■  h:  0  1-—-  /  -*  1 
Ar 


At  • — ■.  n 
n=  I 


U> .  7  1) 


vJ 


.:(J 


The  z-transform  of  the  compounding  distribution  is  in  a  particularly  convenient 
form  as  it  is  given  by  Equation  5.71.  Since  F(z)  is  related  to  the  compounding 
distribution  f(n)  by 


n=0 


zn  f  (n) 


(5.72) 


identification  of  the  terms  of  Equations  5.71  and  5.72  allows  to  write  an  explicit 
form  for  the  compounding  distribution  as  follows: 


In  p 

,  n  >  1  .  (5.73) 

Thus,  a  compound  Poisson  distribution  will  produce  a  demand  governed 
by  the  negative  binomial  distribution  if  the  compounding  distribution  is  of  the 
so-called  "logarithmic"  form.  We  see  from  Equations  5.73  that  there  is  a  finite 
probability,  1  +  ^-  In  p,  that  no  demands  will  be  made  when  an  arrival  occurs. 

If  we  would  like  to  require  at  least  one  demand  from  each  arrival,  then  f(0)  must 
be  made  equal  to  0.  This  can  be  accomplished  by  setting 


f(°)  =  i  + 


p  =  e_Xt/r  .  (5.74) 

Of  course,  it  is  required  that  f(0)  never  be  less  than  0  or  greater  than  1, 
Thus,  we  may  write 


0^  1  +  —  In  p< 


(5.75) 


which  may  be  written  as 


-At/  r 
e 


£  p  <_  1 


(5.76) 
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Suppose  now  that  one  wished  to  represent  a  negative  binomial 
process  with  parameters  r  and  p  by  means  of  a  compound  Poisson  process 
with  Poisson  rate  X  .  Equations  5.73  show  how  the  compounding  distubutio 
should  be  chosen  as  a  function  of  the  observation  interval,  t  ,  and  the  give' 
parameters.  However,  it  will  not  always  be  possible  to  find  a  cornpounuing 
distribution  for  arbitrary  r,  p,  X,  and  t  because  f(Cl)  may  be  negative.  To 
insure  that  this  is  not  the  case,  r,  p,  >,  anu  t  must  meet  the  requJ 
imposed  by  Equation  5.76.  Since  tor  given  r,  p,  and  X,  Equation  5. 7b  can 
always  be  satisfied  by  talcing  t  sufficiently  large,  we  can  say  that  an 
arbitrary  negative  binomial  distribution  can  be  represented  by  a  ■.  umpouno 
Poisson  distribution  with  an  arbitrary  Poisson  rate. 

Let  us  find  the  moments  of  the  compounding  distribution  given  b-. 
Equations  5.73.  Its  2-transform  may  be  written  from  Equation  5.69  as 

r/Xt 

F(z)  «  !  +  ln  -_E_  .  (5.77) 

If  we  refer  to  the  mean,  second  moment,  and  vanance  of  the  compounding 

—  O  ft 

distribution  by  n  ,  n‘  ,  and  ,  we  obtain 


n  * 


dz 


42I1s) 

dz2 


+  n 


z«l 


i 


2 

n 


-  2 
i; 


fru- 

Xtp 


ca. 

Xt 


I 


The  mean,  m,  and  variance,  •  ,  of  the  comoound  Poisson  -iistribiuiu.' 

m 

determined  by  the  moments  of  the  compounding  distribution  ns  snown  .r. 
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Equations  5. 16  and  5.17.  We  find 


and 


m  =  Xt  n 


Xt  S" " rq/p 


(5.79) 


2 

!  m 


Xt  n 


(5.80) 


Comparison  of  Equations  5.57  and  5.59  with  Equations  5.79  and  5.80  show  that 
the  compound  Poisson  distribution  constructed  according  to  Equation  5.73  has 
the  same  mean  and  variance  as  the  original  negative  binomial  distribution. 
Indeed,  the  two  distributions  will  be  identical  in  every  respect. 

Summary 

We  have  now  shown  four  possible  ways  in  which  the  negative 
binomial  distribution  could  be  generated. 

1 .  As  the  probability  of  obtaining  the  rth  success  on  the 
(r+k)th  Bernoulli  trial. 

2.  As  the  probability  distribution  of  the  sum  of  r 
independent  samples  from  the  geometric  distribution. 

3.  As  the  distribution  of  total  demand  where  demand 
in  a  particular  time  Interval  is  Poisson  but  where 
the  Poisson  demand  rate  is  chosen  from  interval 
according  to  an  Erlang  distribution. 

4.  As  a  compound  Poisson  distribution  where  the 
compounding  distribution  is  logarithmic  in  form. 

Other  models  are  no  doubt  possible;  however,  it  would  be  worthwhile 
in  any  inventory  situation  in  which  a  negative  binomial  demand  is  experienced 
to  see  if  one  of  these  four  models  can  explain  die  underlying  phenomenon. 

This  chapter  has  described  the  general  compound  Poisson  distribution 
and  important  members  of  the  family  of  such  distributions.  We  have  seen  two 
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examples  in  which  different  mathematical  models  have  led  to  the  same  observed 
demand  process.  The  compound  Poisson  family  is  particularly  important  because 
it  is  the  only  family  of  discrete  distributions  that  satisfies  the  assumption  of 
independent  demands  in  arbitrary  independent  time  periods.  That  is,  it  is  the 
only  discrete  distribution  that  satisfies 

p(n,t)  =  ^  p(m, t)  p(n-m,  t-T)  ,  0  <t  <  t  (5.81) 

m=0 

This  assumption  is  frequently  made  in  inventory  theory,  often  without  the 
realization  that  it  implies  the  compound  Poisson  demand  process. 


1/  See  Feller.  W. ,  An  Introduction  to  Probability  Theory  and  Its  Applications 
Volume  I,  Second  Edition,  Wiley  1958,  pp.  270  -  272. 
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VI.  THE  ERIANG  DISTRIBUTION 


Introduction 


An  important  recurrent  process  is  that  in  which  the  density  function 
for  the  time  between  events,  a(-r),  is  the  Erlang  distribution  defined  by 
Equation  6.1, 


a(r) 


.  , „ N  .k- 1  -kXT 
kXfltXTj  e 

(k-1) ! 


t>.0  .  (6.1) 


The  Erlang  density  function  has  two  parameters  k  and  X.  The  quantity  k  may 
be  integral  or  non-integral;  when  it  is  non-integral  the  factorial  in  Equation  6 . 1 
must  be  replaced  by  the  corresponding  gamma  function.  Without  loss  of 
generality  we  shall  consider  k  to  be  integral  in  which  case  the  Erlang  distri¬ 
bution  can  be  considered  to  be  the  density  function  of  the  sum  of  k  independent 
samples  from  an  exponential  distribution  with  mean .  It  then  follows 

that  the  mean  of  the  Erlang  distribution  must  be  given  by-^  ,  and  its  variance 

1  A 
by-4-^  .  If  we  compare  Equation  6. 1  with  the  Poisson  density  function, 

Equation  5.4,  and  the  Laplace  transform  of  the  PoisBon  density  function , Equation 

5.3,  the  Laplace  transform  of  the  Erlang  distribution  can  be  written  by  inspection 

as 


A(s)  ■= 


JsJL- 

s+kX 


(6.2) 


If  we  substitute  Equation  6.2  into  Equation  4.7  we  obtain  the  Laplace  transform 
of  the  probability  that  n  events  will  occur  in  a  time  interval  t  after  an  event  as 


n,>0  .  (6.3) 


6  -  1 


We  must  now  invert  this  transform  to  obtain  an  explicit  expression  for  p(n,t)  . 

To  perform  this  inversion,  let  us  consider  the  truncated  exponential 
function,  defined  by 


E 

n 


(x)  =  e"X 


I 


This  function  is  discussed  and  tabulated  by 
Laplace  transform  of  En(x)  •  We  first  write 


Morse^ . 


n>  0  .  (6.4) 

We  shall  now  find  the 


exE  (x) 
n 


$ 


and  then 


L[eXEn(x)] 


=  i  Ml/s)"*1 

s  1  -  1/s 


1 

s-1 


ti¬ 


nt  1 


i 


n>  0  .  (6.5) 


n>  0  .  (6.6) 


However , 

UEnM]  -L[e\M]js.  S+I  ,  (6.7) 


J/  P.M.  Morse.  Queues,  Inventories  and  Maintenance.  Wiley,  New  York,  1958. 
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and  so 


L[E„<*)]  -- 


1  - 


(s+1) 


n+1 


n>0  , 


(6.8) 


We  have  thus  obtained  the  Laplace  transform  of  the  truncated  exponential 
function  defined  by  Equation  6.4.  If  the  truncated  exponential  function  should 
be  written  in  the  form 


E  (ax)  *  e 
n 


-ax  )  (ax)J 

L->  \  I  • 

J-0  31 


(6.9) 


where  a  is  a  constant,  then  we  can  find  the  corresponding  transform  by 
making  use  of  the  Laplace  transform  property 


ny«x>i  --  UEnM]|s.B/a 


(6.10) 


By  using  the  results  of  Equations  6.8  and  6. 10  we  can  finally  write 

n+1 


L[E  (ax)]  -7 


1  - 


(s+a) 


n+1 


n>  0 


(6.11) 


We  can  now  proceed  to  the  inversion  of  the  transform  expression  in 
Equation  6.3.  From  Equation  6.3  with  n*0  we  obtain  the  transform  of  p (0 , t) , 
the  probability  that  no  events  will  occur  in  time  t,  as 


P(0  ,s)  =  — 


(6.12) 


Comparison  of  Equations  6.11  and  6. 12  then  shows  that  p(0,t)  must  be  given  by 


p(0,t) 


_  .  .  -kXt 

Ejt_  l  (kXt)  “  e 


(6.13) 
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When  n  is  larger  than  w*  a- ..to  Equation  6.3  in  the  form 


Phi,  s)  =  —  1  -  ~ ~ - 

s  s-tkX 


|jc*J 

IS-rkX- 


i  j kA ; 

s  ,s+k^; 


.  nk 


kA 


nk 


(n+1)  k 


1 


s 


,  kA  fc*1)k  1  ikx  i1* 

s+kX  s  1  's+kX; 


(6.14) 


If  we  use  Equation  €.13  we  can  write  p(n,t)  the  inverse  transform  of  P(n,s)  as 
p(n,t)  =  £(n+i)  k_  ]  "Enk_i  (kAt)  •  n  >  1  .  (6.15) 

Equation  6.  15  may  be  written  in  the  form 


p(n,t)  =  e 
and  finally,  in  the  form 


[(n-H)k- 1] 

-kXt  \  (kXtr 


1 

L  j=0 


J! 


nk-1 

r*7 

1  * 

1=0  J 


ikXtii 


(6.16) 


[(n+l)k-l] 

p(n,t)  =  e  ^  ,  n>0  .  (6.17) 

j=nk  } 

The  expression  for  p(n,t)  given  by  Equation  6.17  is  valid  for  all  n  greater 

than  or  equal  to  0. 

We  have  thus  obtained  an  explicit  expression  for  the  probability 
that  n  events  will  occur  in  a  time  interval  t  following  a  given  event  for  a 
recurrent  event  process  with  an  Erlang  mterevent  time  density  function.  We 
may  provide  an  important  interpretation  for  this  expression  when  we  note  that 
the  truncated  exponential  function  defined  by  Equation  6.4  is  equal  to  the 


probability  that  a  sample  from  a  Poisson  distribution  of  mean  x  will  be  less 

than  or  equal  to  n.  To  use  this  fact,  we  shall  build  the  following  model  of 

the  process  under  consideration.  Let  us  imagine  a  sequence  of  recurrent 

events  which  we  shall  call  blips.  The  interblip  time  density  function  is 

exponential  wHh  mean  consequently,  blips  are  generated  by  a  Poisson 

K  A 

prucess  of  rate  kA.  If  we  say  that  an  "event"  occurs  at  every  blip  then 
the  events  will  be  a  recurrent  process  with  the  Erlang  interevent  time  density 
function  ot  Equation  b.  1.  The  probability  that  no  event  will  occur  in  a  time 
interval  t  following  an  event  is  the  probability  that  the  number  of  blips  in  the 
time  interval  .  will  be  less  than  or  equal  to  k-1.  Since  the  mean  number  of 
blips  in  time  t  is  k  At,  Equation  6. 13  is  verified  immediately. 

The  probability  that  there  will  be  exactly  n>  1  events  in  a  time 
interval  t,  following  a  given  event,  is  the  probability  that  the  number  of  blips 
in  this  time  interval  will  be  greater  than  or  equal  to  nk,  but  less  than  or  equal 
to  (n+1)  k-1.  It  is  thus  equal  to  the  probability  that  there  will  be  (n+l)k-l  or 
fewer  blips  less  the  probability  that  there  will  be  nk-1  or  fewer  blips.  This 
relation  Is  expressed  exactly  by  Equation  6.15. 

Now  that  we  have  verified  our  results,  let  us  obtain  some  other 
properties  of  the  Erlang  process.  Let  P(r,t)  be  the  probability  that  r  or  fewer 
events  will  occur  in  the  time  interval  t.  Thus  P(r,t)  Is  defined  by 
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Equation  6. 17  allows  us  to  write 


P(r,t) 


[(n+l}k-l] 

)  mi 

j=nk  J1 


-kXt 
=  e 


t 

n=0 


[(n+l)k-l] 

I 

J=nk 


Mil! 

J1 


=  e 


[(rtl)k-l] 

-kXt  I 

J*=0 


mi 

J! 


-  E(r+l)k-l(kXt)  '  -°  •  (6*19) 

The  cumulative  probability  of  events  is  thus  also  given  by  a  truncated  exponential 
function.  Once  more,  the  physical  interpretation  is  clear.  The  probability  that 
there  will  be  r  or  fewer  events  in  time  t  is  Just  the  probability  that  there  will 
be  (r+l)k-l  or  fewer  blips  in  time  t. 

An  expression  for  the  expected  number  of  events  in  time  t,n(t),  is  also 
easily  obtained.  This  quantity  is  defined  by 

00 

n(t)  «=X  nP (n,t)  •  (6.20) 

n=l 

Equation  6.20  can  be  written  in  the  form 


n(t) 


o0  n  oo  n 

■Z  p<n^  Z  icZ  Zp(n'i) 

n=  1  m=  1  n=  1  m=  1 


(6.21) 
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By  reversing  the  order  of  summation  we  obtain 


*  00  oo  .  m^l 

n(t)  L  "  L  |  1  "ZjP^« 
m=  1  n=m  m*=l  n=0 


«Z  [l-PU-^t)] 

m=l 


00 

=Z[i_Emk-i 

m=l 


(leXt)  ] 


(6.22) 


Thus,  an  expression  for  the  expected  number  of  events  in  time  t  is  obtained 
not  in  closed  form  but  as  an  infinite  summation  of  terms  that  are  tabulated  as 
the  probability  that  a  sample  from  the  Poisson  distribution  will  exceed  a 
specified  value.  Recall  that  if  sampling  were  begun  at  random,  the  expected 
number  of  events  in  time  t  would  be  simply  Xt,  as  expressed  in  Equation  4.27. 

The  second  moment  of  the  number  of  events  in  time  t  after  an  event, 
n2(t)  is  calculated  in  a  similar  fashion.  The  defining  relation  is 


JO 

n2(t)  *=Z  n2  p(n,t) 
n*=  1 


(6.23) 


Proceeding  as  before,  we  write 


__  *  a,  o°  n 

n2(t)  »=Z  P(n,t)  Z  (2m- 1)  »Z  Z^2"1"1)  P^1'1 
n**l  m=l  n=lm“l 


(6.24) 
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The  same  change  in  order  of  summation  yields. 


00  00 

n2(t)  =  ^  (2m- 1)  p(n,t) 


m=l 


n=m 


00 


=  X  tern-1) 

m=l 


r 


00 

■  ^  (2m- 1)  [1  -  P (m- 1 , t)  ] 
m=l 

00 

«  £  (2m- 1)  [  1  -  Zmk_1  (kXt)]  .  (6.25) 

m=l 

The  expression  for  the  second  moment  of  the  number  of  events  in  time  t  after 
an  event  involves  summation  over  the  same  tabulated  terms  required  for  the 
calculation  for  the  first  moment;  however,  these  terms  are  now  weighted  by  an 
additional  factor. 

An  Interesting  compound  process  results  when  the  sampling  process 
is  the  recurrent  Erlang  that  we  have  been  discussing.  In  the  compound  process 
at  each  event  time  some  number  of  hyperevents  determined  by  a  compounding 
distribution  also  occurs.  For  an  arbitrary  compounding  distribution  it  is  quite 
difficult  to  determine  the  probability  that  a  given  number  of  hyperevents  will 
occur  in  a  time  interval  t.  However,  the  mean  and  variance  of  the  number  that 
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will  occur  can  be  calculated  by  knowing  the  first  and  second  moments  of  the 
compounding  distribution  and  the  first  and  second  moments  of  the  sampling 
distribution.  These  latter  quantities  are  given  for  the  compound  Erlang 
distribution  by  Equations  6.21  and  6.25  respectively.  Consequently,  with 
some  numerical  effort  the  important  moments  of  a  compound  Erlang  distribution 
can  be  obtained. 
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APPENDIX 


DEVELOPMENT  OF  THE  COMPOUND  DISTRIBUTION  FOR  A  COMPOUNDING 
DISTRIBUTION  HAVING  FOR  ITS  DOMAIN  ANY  REAL  NUMBER 


This  appendix  will  develop  the  theory  of  the  compound  distribution 
for  a  continuous  compounding  distribution  f(n) .  As  in  Chapter  III,  let  m  be 
the  sum  of  k  samples  from  the  density  function  f(n).  We  wish  to  find  the 
compound  distribution  h(m)  generated  by  the  functions  g(k),  the  sampling 
distribution,  and  f(n).  From  Equation  3. 1  we  have 


h(m)  -  X  9k)  h(m|k) 
k-0 


(A.  1) 


Since  m  is  the  sum  of  k  independent  samples  of  f(n) ,  the  probability  density 
h(mjk}  is  given  by  the  k-fold  convolution  of  f(n),  denoted,  as  before,  by 
fk*(m).  We  define 

00 

fk*(m)  -  \  f (x)  f Ck- i)*  (m-x)  dx  ,  k>  1  , 

for  ihfO 

otherwise  .  (A.  2) 

We  can  now  write  Equation  A.  1  as 


and 


f°*(m)  ■ 


h(m) 


(A.  3) 


A  -  1 


Let  H(jw)  and  F  (ju>)  be  the  Fourier  transforms  of  the  density  functions 

h(m)  and  f(n),  defined  by 


00 

H(jw)  =  y  h(m)  e  ^umdm  , 


and 


•a.1 

’(jtj)  =  J  f(n) 
-00 


e-J“ndn  . 


(A.  4) 


Also,  let  us  define  the  z-transform  of  the  sampling  distribution,  G(z)  as 

(A.  5) 


oc 

V1 


G(z)  «=2_,  g(k)  zk 
k“0 


-Jwm 


If  we  multiply  both  sides  of  Equation  A.  3  by  e  and  integrate  over  all  m, 
we  obtain 


00  “0  00 

f  h(nO  e'Jum  dm -2,900  f 


fk*  (m)  e-^m  dm 


(A.  6) 


Since  the  Fourier  transform  of  the  k-fold  convolution  of  f(n)  is  the  Fourier 
transform  of  f(n)  raised  to  the  k^  power,  then  using  the  definitions  of  Equation 
A, 4,  we  may  write  Equation  A, 6  as 


00 

H(jw)  =7  g(k)  [F(Ju)]k  . 
k=0 

The  definition  of  G(z)  in  Equation  A.  5  allows  us  to  write 


(A.  7) 


HOu)  =  G  [F (Jw)] 


(A.  8) 


A  -  2 


This  shows  that  the  Fourier  transform  of  the  compound  distribution,  h(m) , 
is  the  z-transform  of  the  sampling  distribution,  taking  z  to  be  the  Fourier 
transform  of  the  compounding  distribution. 

Let  us  find  the  moments  of  the  compound  distribution  in  terms  of 
the  moments  of  the  sampling  and  compounding  distributions.  The  r^1  moment 
of  a  distribution  is  given  in  terms  of  its  Fourier  transform,  B(ju),  as 


=  jr  5V 

du 


B(ju>) 


upO 


(A.  9) 


Then,  using  Equation  A. 9,  we  find 


n=  F(Ju)  !  _n  =  JF*  (0) 

8  uj  'upU  u) 


n2  =  J2  ^~2  F(ju) 
8w 


upO 


=  j2FM  (0) 

(J 


(A.  10) 

(A.  11) 


and 

a2  =  j2F"  (0)  -  [JF*  (0)]2  .  (A.  12) 

n  w  w 

-  2  ,  . 
The  mean,  m,  and  variance  ,  a  ,  of  the  compound  distribution,  h(m). 


may  be  obtained  as  follows: 

H(ju)  -  G  [FGw)] 

(A.  13) 

JH*  Gw)  =  G'  [FGoJ]  JF'  Gw) 

w  W 

(A.  14) 

m  =  JIl'  Gw)  =  G'  [Tm  JF*  (0)  . 

u  lpO  w 

(A.  15) 

A  -  3 


However, 


I £W 


dn  ■  1 


(A.  16) 


Therefore , 


m  =  G  1  (1)  n 


=  kn 


(A.  17) 


This  result  agrees  with  Equation  3,11  for  the  case  of  discrete  compounding 
distributions. 


For  the  variance  we  compute 


?  -  m2  -  m2  «  <  J2H"  Gu)  -  [JH  '  0u)]2v  1 


(A.  18) 


i  u=0  . 


First,  let  us  evaluate 


)  H  Gu)  -  G"  [FGu)]  [JF  Gu)]  2  ♦  G*  [F Gu)]  J2  F"  Gu)  ,  (A.  19) 

U)  U  (J 


£  -  G-  [F(0)]  n2  +G*  [  F(0)]  n2  -  (k  2  . 


(A.  20) 


G"  (1)  -  a?  -  k  +  k2  . 


(A.  21) 


Therefore , 


°m  "  tak  ~  ^  +  ^2]  n2  +  K  n2  -  k2  n2 


A  -  4 


2-2  c  -2  .  r2  -2  ^  r  2  r-2  -2 

“u^n  -kn  +  k  n  +  kn  -k  n 

2-2  ~2  -  -Z, 

“  cr^  n  +  (kn  -k  n“ 

=  n2aj+kcrj  (A.22) 

k  n 

Again,  this  result  agrees  exactly  with  Equation  3.13  for  the  corresponding  discrete 
case . 


A  -  5 


